ELECTRONIC CATALOGUE SYSTEM, AND SERVER, PROGRAM AND RECORDING 
MEDIUM USED IN ELECTRONIC CATALOGUE SYSTEM 



[0001] This application is based on application No. 
JP2001-33177 filed in Japan, the contents of which is hereby 
incorporated by reference, 

BACKGROUND OF THE INVENTION 

Field of the Invention 

[0002] The present invention relates to an improved 
electronic catalogue system, and a server, a computer program 
and a recording medium used in this electronic catalogue system. 
[0003] The present invention more particularly relates to 
an electronic catalogue system with which it is possible to look 
at commercial products from various angles, and a server, a 
computer program and a recording medium used in this electronic 
catalogue system. 

Description of the Related Art 

[0004] As high-performance personal computers have become 
widely used in households and telecommunications technologies 
such as the Internet have advanced, systems such as Internet 
shopping which allow people to enjoy shopping through computers 
which are connected to the Internet have developed and put into 



actual use. 

[0005] Allowing users to do shopping without going out, such 
a system is convenient to the users. On the contrary, since 
the users can not pick up actual products with hand, it is difficult 
for the users to learn about the sizes of the products, etc. 
While the sizes of the products may be displayed on a screen 
as numerical figures, the users merely looking at such figures 
can not easily have a sensory grasp on the sizes of the products . 
[0006] Noting this, methods requiring to improve the visual 
image of a commercial product to display on a computer screen 
have been proposed. For instance, among the proposed methods 
is a method which require to display on a screen side by side 
the image of a product viewed from one direction and the image 
of an article for comparison ( JP1997-218769A) . With this method, 
if a commercial product is a product which has been widely known 
from before, most users can develop sensory perception of the 
size of the product based on information the users have learned 
so far. 

[0007] However, if a commercial product is a product which 
a user sees for the first time, the image of the product viewed 
f romone direction alone does not permit the user to easily develop 
a good feeling on the size of the product. Further, even though 
the product has existed from before, if the product was largely 
modified in terms of size or to adopt an innovative design, it 
is possible that the user will fail to grasp the size of the 



product and accordingly have false recognition. The problems 
above are increasingly likely, as the market these days demand 
new products, products having small sizes or products having 
innovative designs • 

OBJECTS AND SUMMARY 

[0008] The present invention has been made in light of the 
background as described above. Accordingly, an object of the 
present invention is to provide an improved electronic catalogue 
system, and a server, a computer program and a recording medium 
used in this electronic catalogue system. 

[0009] More particularly, the present invention relates to 
an improved electronic catalogue system with which it is possible 
to look at commercial products from various angles, and a server, 
a computer program and a recording medium used in this electronic 
catalogue system. 

[0010] More precisely, the present invention aims at 
providing an electronic catalogue system which allows a user 
to easily develop sensory perception of the size of a product, 
and a server, a computer program and a recording medium used 
in this electronic catalogue system. 

[0011] To achieve the object above and other objects, an 
electronic catalogue system according to one aspect of the 
present invention is an electronic catalogue system for 
displaying on one screen the image of a commercial product and 



the linage of an article for comparison which is for comparing 
the size with the commercial product and notifying the size, 
comprising reader which reads three-dimensional data of the 
commercial product and three-dimensional data of the article 
for comparison, observation image generator which generates an 
observation image in which the commercial product and the article 
for comparison are located at predetermined positions based on 
thus read three-dimensional data of the commercial product and 
three-dimensional data of the article for comparison, and 
displaying device which displays the generated observation 
image • 

[0012] Preferably, designator which designates a rotation 
axis and an angle of rotation and rotating device which rotates 
the observation image based on the designated rotation axis and 
the designated angle of rotation are provided. 
[0013] Alternatively, designator which designates a rotation 
axis and an angle of rotation for each one of the commercial 
product and the article for comparison and rotating device which 
rotates the image the commercial product or the image of the 
article for comparison based on the designated rotation axis 
and the designated angle of rotation are provided. 
[0014] Other aspect of the present invention requires to 
dispose device which automatically selects the article for 
comparison in accordance with the type and the size of the 
commercial product . 



[0015] Further, article for comparison storing device which 
stores three-dimensional data of a plurality of articles for 
comparison and selector which selects the three-dimensional data 
of one article for comparison from the article for comparison 
storing device are disposed, and the reader reads the 
three-dimensional data of the selected article for comparison. 
[0016] Further, product storing device which associates 
product information regarding features of the commercial product 
with the three-dimensional data of the commercial product and 
p stores the product information is disposed, and the displaying 

^ device displays the observation image together with the product 

■ffil 

"^I information which corresponds to the image of the commercial 

ffl product which is included in the observation image. 

O [0017] A server according to a certain aspect of the present 

O invention is a server used in an electronic catalogue system 

C| for displaying on one screen the image of a commercial product 

fll 

and the image of an article for comparison which is for comparing 
the size with the commercial product and notifying the size, 
and the server comprises three-dimensional data storing device 
which stores three-dimensional data of the commercial product 
and three-dimensional data of the article for comparison, image 
generator which generates the image of the commercial product 
and the image of the article for comparison based on the 
three-dimensional data of the commercial product and the 
three-dimensional data of the article for comparison stored in 
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the three-dimensional data storing device, andsender which sends 
the generated image of the commercial product and the generated 
image of the article for comparison. 

[0018] A computer program according to a certain aspect of 
the present invention is a computer program for a terminal 
apparatus used in an electronic catalogue system for displaying 
on one screen the image of a commercial product and the image 
of an article for comparison which is for comparing the size 
with the commercial product and notifying the size, and the 
computer program cases the terminal apparatus to execute 
processing of reading three-dimensional data of the commercial 
product and three-dimensional data of the article for comparison, 
processing of generating an observation image in which the 
commercial product and the article for comparison are located 
at predetermined positions based on thus read three-dimensional 
data of the commercial product and three-dimensional data of 
the article for comparison, and processing of displaying the 
generated observation image. 

[0019] A computer program according to a different aspect 
of the present invention is a computer program for a terminal 
apparatus used in an electronic catalogue system for displaying 
the image of a commercial product on a screen, and the computer 
program cases the terminal apparatus to execute processing of 
reading data which are for generating the image of the commercial 
product and data which are for generating the image of an article 



for comparison which is for comparing the size with the commercial 
product and notifying the size, processing of generating an 
observation image in which the commercial product and the article 
for comparison are located at predetermined positions based on 
respective thus read data, and processing of changing a 
positional relationship between the commercial product and the 
article for comparison and updating the observation image. 
[0020] Further, the terminal apparatus is made execute 
processing of automatically selecting the article for comparison 
in accordance with the type and the size of the commercial product . 
[0021] A computer program according to still other aspect 
of the present invention is a computer program for a terminal 
apparatus used in an electronic catalogue system for displaying 
the image of a commercial product on a screen, and the computer 
program cases the terminal apparatus to execute processing of 
reading data which are for generating the image of a first 
commercial product and the image of a second commercial product, 
and processing of generating an observation image in which the 
commercial products and the article for comparison are located 
at predetermined positions based on respective thus read data, 
[0022] A recording medium according to a certain aspect of 
the present invention is a recording medium which can be read 
on a computer and which holds any one of the computer programs 
above . 



BRIEF DESCRIPTION OF THE DRAWINGS 

[0023] These and other objects and features of the present 
invention will become apparent from the following description 
of preferred embodiments thereof taken in conjunction with the 

accompanying drawings, in which; 

[0024] Fig. 1 is a drawing of the structure of an electronic 
catalogue system according to the present invention; 
[0025] Fig* 2 is a drawing of the functional structure of 
an electronic catalogue system in a first preferred embodiment; 
[0026] Fig. 3 is a drawing showing an example of the image 
of a commercial product; 

[0027] Fig. 4 is a drawing showing an example of a catalogue 
view; 

[0028] Fig. 5 is a drawing showing an example of a comparison 
article list view; 

[0029] Fig. 6 is a drawing showing a size designation view; 
[0030] Fig. 7 is a drawing for describing auto-rotation and 
orbital rotation of an article for comparison; 
[0031] Fig. 8 is a drawing for describing the principle of 
processing of rotating an image; 

[0032] Fig. 9 is a drawing showing an example of an angle 
designation view; 

[0033] Fig. 10 is a drawing for describing an example of a 
change in displaying magnification; 

[0034] Fig. 11 is a drawing for describing a change in position 



of article for comparison; 

[0035] Fig. 12 is a drawing showing an example of an ordering 
view; 

[0036] Fig. 13 is a flow chart for describing the outline 
of the flow of overall processing in a terminal apparatus; 
[0037] Fig. 14 is a flow chart showing an example of processing 
of displaying a commercial product; 

[0038] Fig. 15 is a flow chart showing an example of processing 
of automatic selection of an article for comparison; 
[0039] Fig. 16 is a flow chart showing an example of processing 
of rotating an article for comparison; 

[0040] Fig. 17 is a flow chart showing an example of processing 
of rotating an article for comparison and a commercial product; 
[0041] Fig. 18 is a flow chart showing an example of processing 
of moving an article for comparison; 

[0042] Fig. 19 is a drawing of the functional structure of 
an electronic catalogue system in a second preferred embodiment; 
[0043] Fig. 20 is a drawing showing an example of a commercial 

product view; 

[0044] Fig. 21 is a drawing showing an example of a commercial 
product view which shows a plurality of commercial products; 
and 

[0045] Fig. 22 is a drawing showing an example of an observation 

window which shows a ruler and the like. 

[0046] In the following description, like parts are 



designated by like reference numbers throughout the several 
drawings . 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[First Preferred Embodiment] 
[Structure of System] 

[0047] Fig, 1 is a drawing of the structure of an electronic 
catalogue system 1 according to the present invention, and Fig. 
2 is a drawing of the functional structure of the electronic 
catalogue system 1 in a first preferred embodiment. 
[0048] As shown in Fig. 1, the electronic catalogue system 
1 is formed by a server 11, a terminal apparatus 12, and a 
communication line 13 which connects the server 11 and the 
terminal apparatus 12. 

[0049] The server 11 is formed by a server main unit 11a, 
a display apparatus lib, a key board 11c, a mouse lid and the 
lilce. The server main unit 11a is formed by a CPU, a RAM, a 
ROM, a magnetic storage apparatus, a communication control 
apparatus, etc. A three-dimensional input apparatus lie is 
connected to the server main unit 11a. 

[0050] Programs such as an operating system and various 
applications are installed in the magnetic storage apparatus. 
These programs are read to the RAM in accordance with necessity 
and executed by the CPU. Other necessary data are also stored. 
[0051] The terminal apparatus 12 is formed by a terminal 



apparatus main unit 12a, a display apparatus 12b, a key board 
12C/ a mouse 12d and the like, which is approximately similar 
to the server 11. 

[0052] Programs such as an operating system and various 
applications are installed in a magnetic storage apparatus of 
the terminal apparatus main unit 12a • Of those, a processing 
program for image processing which will be described later is 
downloaded from the server 11 and stored in the magnetic storage 
apparatus. This processing program is written in a language 
such as VRML (Virtual Reality Modeling Language) and JAVA. 
[0053] The display apparatus 12b, as shown in Fig. 3, displays 
an observation image IM which contains a product image IMA, which 
is the image of a commercial product Q, and a comparison article 
image 1MB which is the image of an article for comparison R. 
Visually comparing the product image IMA with the comparison 
article image 1MB, a user can grasp the size of the commercial 
product Q with his or her sense . In short, the comparison article 
image 1MB is an index image which serves as an index for developing 
sensory recognition of the commercial product Q. 
[0054] The product image IMA and the comparison article image 
1MB are generated based on three-dimensional data DTA and DTB, 
respectively. Hence, it is possible to generate the product 
image IMA or the comparison article image 1MB which shows the 
commercial product Q or the article for comparison R as viewed 
from a desired direction. 



[0055] The three-dimensional data DTA and DTB are acquired 
through three-dimensional measurement of the commercial product 
Q and the article for comparison R, respectively, by means of 
the three-dimensional input apparatus lie or the like. 
Alternatively^ the three-dimensional data may be generated from 
computer graphics using appropriate application software or by 
synthesizing computer graphics with data obtained by 
three-dimensional measurement, 

[0056] As the communication line 13, a public network, a 
dedicated line, LAN, WAN or the Internet may be used. 
[0057] Having such a structure, the electronic catalogue 
system 1 realizes a functional structure as that shown in Fig. 
2. 

[0058] As shown in Fig. 2, the server 11 includes a 
communication control part 111, a data storage part 112, an 
ordering part 113, etc. The terminal apparatus 12 includes a 
communication control part 121, an image designation part 122, 
a rotation calculation part 123, an observation image generating 
part 124, a displaying part 125, a position/size calculation 
part 126, an ordering part 127, etc. 

[0059] The communication control parts 111 and 121 control 
trans f er of a program or data between the server 1 1 and the terminal 
apparatus 12. For instance, the three-dimensional data DTA, 
DTB, respective data which will be described later or a processing 
program for image processing are transferred. 
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[0060] The data storage part 112 stores the three-dimensional 
data DTA, product information DTQ and simple image data KGA 
regarding each commercial product Q, and the three-dimensional 
data DTB and simple image data KGB regarding each article for 
comparison R. Further, these data are extracted and sent to 
the terminal apparatus 12, in response to a request from the 
terminal apparatus 12. 

[0061] The product information DTQ is information regarding 
features of the commercial products Q, such as the product names 
and prices. The simple image data KGA are image data for 
displaying simple images which are simple to an extent that users 
can see approximate shapes of the commercial products Q during 
designation of the commercial products Q. The simple image data 
KGB similarly are image data representing the articles for 
comparison R used for designation of the articles for comparison 
R. As such simple images, two-dimensional small images 

(thumbnail images) may be used for example. 

[0062] A method of displaying the functions of the respective 
portions, the commercial products Q and the articles for 
comparison R will now be described with reference to views which 
are displayed on the display apparatus 12b of the terminal 
apparatus 12 . 

[0063] Fig. 3 is a drawing showing an example of a commercial 
product view HGl, Fig. 4 is a drawing showing an example of a 
catalogue view HG2, Fig. 5 is a drawing showing an example of 



a comparison article list view HG3, Fig. 6 is a drawing showing 
a size designation view HG4, Fig. 7 is a drawing for describing 
auto-rotation and orbital rotation of the article for comparison 
R, Fig. 8 is a drawing for describing the principle of processing 
of rotating an image^ Fig. 9 is a drawing showing an example 
of an angle designation view HG5, Fig. 10 is a drawing for 
describing an example of a change in displaying magnification, 
and Fig. 11 is a drawing for describing a change in position 
of the article for comparison R. 
[Commercial Product View] 

[0064] As the commercial product Q is selected in response 
to an instruction fromauser with the catalogue view HG2 displayed, 
for example, the commercial product view HGl as that shown in 
Fig. 3 is displayed. 

[0065] The catalogue view HG2 is displayed, as the terminal 
apparatus 12 accesses the server 11 and catalogue information 
comprising the product information DTQ and the simple image data 
KGA is downloaded (Fig. 4) . Such a function of the terminal 
apparatus 12 is provided through WWW browser used on the Internet, 
for instance. 

[0066] In Fig. 3, the commercial product view HGl is formed 
by an observation window WNl, buttons BOl to B13 and the like. 
The purposes of major buttons and the functions of the buttons 
when clicked will now be described. 

[0067] The button BOl is for rotating the product image IMA. 



- 14 - 



SI 



within the observation window WNl . The button B02 is for moving 
the product image IMA within the observation window WNl, The 
button BOS is for selecting the commercial product Q which is 
to be displayed as the product image IMA. This allows to select 
a plurality of commercial products Q and display the commercial 
products Q side by side* The button B04 is for rotating the 
comparison article image 1MB within the observation window WNl . 
The button BOS is for moving the comparison article image 1MB 
within the observation window WNl . ThebuttonB06 is for changing 
the comparison article image 1MB. 

[0068] The button B07 is for automatically selecting the 

comparison article image 1MB and displaying the comparison 

SI 

article image 1MB adjacent to the product image IMA which is 
already displayed. The button BOS is for a user to select the 
5 comparison article image 1MB. The button B09 is for a user to 

^5 enter the comparison article image 1MB. The button BIO is for 

enlarging images within the observation window WNl at a 
predetermined magnification or any desired magnification. The 
button Ell is for reducing images within the observation window 
WNl at apredeterminedmagnif icationor any desiredmagnif ication. 
The other buttons will be described later when necessary. 
[0069] The content of the observation window WNl and whether 
to display the buttons BOl to B13 changes in accordance with 
instructions given from a user. 

[0070] For instance, in Fig. 3, at an initial stage that the 
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commercial products Q is designated, the product image IMA alone 
is displayedbut the comparison article image 1MB is not displayed 
in the observation window WNl , At this stage, only the buttons 
BOl to B03, the buttons B07 to B09, the buttons BIO to Bll and 
a return button are displayed as buttons* 

[0071] As the article for comparison R is designated and the 
comparison article image 1MB is displayed, the buttons B04 to 
B06 are displayed instead of the buttons B07 to B09. As the 
button B06 is clicked, the buttons B07 to B09 are displayed again 
instead of the buttons B04 to B06 • As the button B05 is clicked, 
the button B13 is newly displayed. When the button BOl and the 
button B04 are clicked together, the button B14 and the button 
B15 are newly displayed, 

[0072] Now, an observation image IM including the product 
image IMA and the comparison article image 1MB is displayed in 
the observation window WNl* Further, the product information 
DTQ corresponding to this the commercial products Q is displayed. 
In Fig. 3, a price and a product name are displayed as the product 
information DTQ. When the commercial products Q or the article 
for comparison R is not designated, however, the observation 
image IM is not displayed* The observation image IM is displayed 
when the respective processing which will be described later 
is performed. 

[0073] Referring back to Fig. 2 once again, the image 
designation part 122 executes processing for designation or 



modification regarding displaying of the observation image IM, 
such as designation of the commercial product Q which a user 
wishes to watch and the article for comparison R which is to 
be compared with the commercial product Q, designation of a 
rotation axis and an angle of rotation for rotating the commercial 
product Q or the article for comparison R, and designation or 
modification of a displaying magnification for the observation 
image IM» 

[0074] These are designated in the following manner, as a 
user manipulates the key board 12c or the mouse 12d while looking 
at the views or windows in Figs. 3 through 11 displayed on a 
display screen of the display apparatus 12b and causes the CPU 
to perform comparison, calculation, etc. 

[0075] As shown in Fig, 4, in the catalogue view HG2, based 
on the simple image data KGA and the product information DTQ, 
simple images GA of the commercial products Q and information, 
such as the product names and prices, regarding the commercial 
products Q are displayed for the respective commercial products 
Q, Further, as shown in Fig. 5, in the article for comparison 
list view HG3, simple images GB of a plurality of articles for 
comparison R are displayed based on the simple image data KGB. 
[Designation of Commercial Product] 

[0076] The commercial product Q displayed in the commercial 
product view HGl in Fig. 3 is designated in the catalogue view 
HG2 which is shown in Fig. 4. That is, as the button B03 is 



clicked in the commercial product view HGl, the catalogue view 
HG2 is displayed. As one simple image GA is selected from the 
simple images GA and clicked in the catalogue view HG2/ this 
simple image GA is recognized and the corresponding commercial 
product Q is designated. Following this, the commercial product 
view HGl is displayed together with the designated commercial 
product Q. 

[0077 ] It is possible to display one or more than one commercial 
products Q in the commercial product view HGl which is shown 
in Fig. 3. Various methods are available for selection of the 
number of the commercial products Q displayed in the commercial 
product view HGl . For instance, in the catalogue view HG2 which 
is shown in Fig. 4, the simple images GA corresponding to the 
commercial products Q to be displayed are clicked and accordingly 
highlighted, and an OK button is clicked in this condition. As 
a result, the commercial products Q represented by the 
highlighted simple images GA are selected. On the contrary, 
when one of the commercial products Q displayed in the commercial 
product view HGl is not to be displayed, the simple image GA 
which is not to be displayed is clicked in the catalogue view 
HG2 so that the highlighting is eliminated, and the OK button 
is clicked in this condition. 
[Designation of Article for Comparison] 
[00781 The article for comparison R displayed in the 
commercial product view HGl in Fig. 3 is designated in the article 



for comparison list view HG3 which is shown in Fig* 5. In other 
words, as the button BOS is clicked in the commercial product 
view HGl, the article for comparison list view HG3 appears. In 
the article for comparison list view HG3, one simple image GB 

is selected and the corresponding article for comparison R is 
designated* 

[0079] Based on the size of the designated article for 
comparison R and the size of and the displaying magnification 
for the product image IMA which is already displayed, a displaying 
magnification for the article for comparison R is calculated. 
The article for comparison R is displayed at a predetermined 

'^i position within the observation window WNl based on the 

ff'^ calculated displaying magnification. 

5 [0080] The article for comparison R may be automatically 

ill 

P designated by calculation. That is, the already selected 

P commercial product Q is compared through calculation with each 

m 

article for comparison R stored in the data storage part 112 
of the server main unit 11a, and the article for comparison R 
is designatedbasedonaresult of the calculation. For instance, 
the article for comparison R is identified in the following 
sequence . 

[0081] The articles for comparison R which are of the same 
type or close in type to the already selected commercial product 
Q or which are used together with the commercial product Q are 
extracted. When the type of the commercial product Q is 
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"furniture" for example, "tableware" to be placed around the 
furniture is extracted as the articles for comparison R. From 
the extracted articles for comparison R, one article for 
comparison R corresponding to the size of the commercial product 
Q is calculated* For instance, setup is made in advance so as 
to calculate the articles for comparison R whose size is at a 
predetermined proportion to the commercial product Q. The 
articles for comparisons R which are relatively large are 
consequently designated for the large commercial products Q but 
the articles for comparisons R which are relatively small are 
consequently designated for the small commercial products Q. 
[0082] The processing of automatically designating the 
articles for comparison R is started as the button B07 is clicked 
in the commercial product view HGl • 

[0083] Alternatively, instead of designating from the 
articles for comparison R which are stored in the server 11, 
a method that users generate the articles for comparison R is 
used. As shown in Fig. 6 for example, a rectangular article 
for comparison RX is generated. As the article for comparison 
RX specified by designating the lengths Rs, Rt and Ru of the 
respective sides of the article for comparison RX, an article 
for comparison R is generated. In short, a user inputs the 
lengths of the respective sides of the article for comparison 
RX respectively in text boxes TBll, TB12 and TB13 in the size 
designation view HG4 which is shown in Fig. 6, and accordingly 



generates the article for comparison R. Based on the size of 
thus generated article for comparison R and the size of and the 
displaying magnification for the product image IMA which is 
already displayed, a displaying magnification for the article 
for comparison R is calculated. The size designation view HG4 
is displayed as thebuttonB09 is clicked in the commercial product 
view HGl which is shown in Fig. 3. 

[Rotation of Commercial Product and Article for Comparison] 
[0084] Next, rotation of the commercial products Q and the 
Q articles for comparison R will be described. 

ffl [0085] First, when the commercial product Q is to be rotated, 

r, J 

\l the button BOl shown in Fig. 3 is clicked. As a result, the 

p button BOl is highlighted. With a mouse pointer placed on a 

p part of the commercial product Q, the mouse is moved while pressing 

5^ si 

Q mouse button (dragging) . Data corresponding to the direction 

PI of dragging and the amount of the movement are accordingly 

I y 

supplied to the image designation part 122. As a result, the 
commercial product Q alone is rotated in accordance with the 
direction in which the mouse is moved and the amount of the 
movement . 

[0086] Next, when the article for comparison R is to be rotated, 
the button B04 is clicked. The button B04 is accordingly 
highlighted. In a manner similar to the above, the article for 
comparison R is dragged. As a result, the article for comparison 
R alone is rotated in accordance with the direction in which 
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the mouse is moved and the amount of the movement, 
[0087] When both the commercial product Q and the article 
for comparison R are to be rotated, after clicking both the button 
BOl and the button B04, a rotation mode is selected. The button 
BOl and the button B04 are highlighted as both the button BOl 
and the button B04 are clicked, and the buttons B14 and B15 are 
newly displayed for selection of a rotation mode. 
[0088] Among rotation modes are an auto-rotation mode for 
rotating (auto-rotation) the commercial product Q and the article 

Q for comparison R individually and an orbital rotation mode for 

CI 

ffl rotating the entirety while maintaining the relative positions 

m 

Si of the two. The auto-rotation mode is invoked when the button 

m B14 is clicked, while the orbital rotation mode is invoked when 

O the button BOS is clicked. 

O [0089] In the auto-rotation mode, as the commercial product 

® 

Q Q or the article for comparison R is dragged, as shown in Fig. 

El 

7(a), the commercial product Q and the article for comparison 
R are caused to rotate at the respective positions in the same 
direction at the same angle in accordance with the direction 
in which the mouse is moved and the amount of the movement. 
[0090] In the orbital rotationmode, as the commercial product 
Q or the article for comparison R is dragged, as shown in Fig. 
7 (b) , the commercial product Q and the article for comparison 
R rotate as a whole while maintaining their relative positions 
to each other. At this stage, without an orbital rotation axis 
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designated, the two rotate about the central axis of the 
commercial product Q. In other words, the commercial product 
Q rotates about its central axis on its own and the article for 
comparison R rotates around the commercial product Q. 
[0091] Conventional methods may be used as an algorithm for 
generating an image of a three-dimensional article which is 
rotated by dragging the mouse* 

[0092] Referring back to Fig. 2 once again, the rotation 
calculation part 123 calculates a rotation axis and an angle 
of rotation for rotating the commercial product Q or the article 
for comparison R, based on designation supplied from the image 
designation part 122. The observation image generating part 
124 generates the observation image IM for two-dimensional 
displaying, based on an output from the rotation calculation 
W part 123. 

m 

O [0093] In other words, based on the three-dimensional data 

DTA, DTB, the observation image generating part 124 generates 
a two-dimensional image rotated at an angle of rotation about 
a rotation axis designated by the rotation calculation part 123 . 
Such processing of rotating images is processing of changing 
the relative positional relationship between the 
three-dimensional data DTA and the position of a view point, 
and is an approach which is used generally in the field of CG 
(computer graphics) . 

[0094] That is, as shown in Fig. 8, coordinate axes X, Y and 
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Z for the three-dimensional data DTA regarding a commercial 
product, for instance, are decided to be rotation reference axes • 
The commercial product image of a commercial product is an image 
which is viewed from a view position regarding which the 
three-dimensional data DTA were designated. This view position 
is considered LA, When the commercial product image is to be 
rotated, assuming that the view position is to be rotated from 
LA to LB using the axis Z as a rotation axis, an image as it 
is at the post-rotation view position LB is calculated and 
displayed. In a similar manner, the image may be rotated using 
the axis X or Y as a rotation axis. Thus, a user can observe 
the commercial product Q from any desired direction while 
rotating the commercial product Q in any direction at any angle. 
This similarly applies to where the article for comparison R 
is to be rotated. 

[0095] In the example described above, the direction in which 
an image is rotated and the angle at which the image is rotated 
are determined from the direction in which the mouse is dragged 
and the amount of the movement. As a different method, the 
direction in which an image is rotated, the angle at which the 
image is rotated and the like may be designated in the angle 
designation view HG5 as that shown in Fig. 9. 
[0096] That is, angles of rotation about the axes X, Y and 
Z are entered for designation in text boxes TB21, TB22 and TB23 
which are displayed within the angle designation view HG5 . When 



the positions of the axes X, Y and Z are to be changed, each 
axis may be dragged with the mouse. 

[0097] When the commercial product Q is to be rotated for 
instance, the button BOl shown in Fig. 3 is clicked and the angle 
designation view HG5 is retrieved. When the article for 
comparison R is to be rotated, the button B04 is clicked and 
the angle designation view HG5 is retrieved. When both the 
commercial product Q and the article for comparison R are to 
be rotated, the button BOl and the button B04 are clicked and 
the angle designation view HG5 is retrieved. 
[0098] When both the commercial product Q and the article 
for comparison R are to be rotated, instead of clicking the button 
BOl and the button B04, a dedicated button for designating 
rotation of the entirety may be disposed. 
[Modification of Displaying Magnification] 

[0099] A displaying magnification for the observation image 
IM is designated or changed by means of the buttons BIO and Bll 
shown in Fig. 3. The displaying magnification increases by a 
predetermined value every time the button BIO is clicked but 
decreases by a predetermined value every time the button B12 
is clicked. For example, every time the button Bll or B12 is 
clicked, the displaying magnification increases or decreases 
5%. 

[0100] Although as the displaying magnification increases, 
both the commercial product Q and the article for comparison 



R are displayed become accordingly larger^ comparison with the 
commercial product Q becomes difficult if the article for 
comparison R becomes too large* In this case, the article for 
comparison R as it is currently displayed is replaced with the 
smaller article for comparison R, and a new observation image 
IM is generated and displayed. 

[0101] In a similar manner, when the article for comparison 
R becomes too small in accordance with a decrease in displaying 
magnification, the article for comparison R as it is currently 
displayed is replaced with the larger article for comparison 
R, and a new observation image IM is generated and displayed, 
[0102] In short, when the display size of the comparison 
article image 1MB becomes larger than a predetermined size, the 
comparison article image 1MB is changed to the comparison article 
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image which is one size smaller. On the contrary, when the 

.y a 

display size of the comparison article image 1MB becomes smaller 
than a predetermined size, the comparison article image 1MB is 
changed to the comparison article image which is one size larger , 
[0103] For example, when the comparison article image 1MB 
becomes too small to easily observe in accordance with a decrease 
in displaying magnification as in an observation window WNla 
showninFig. 10(a), the article for comparisonR in an observation 
window WNlb shown in Fig. 10(b) is replaced with something larger 
than the article for comparison R which is in the observation 
window WNla, such as "human being." 
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[0104] Referring back to Fig. 2 once again, the observation 
image generating part 124 generates the observation image IM 
for two-dimensional displaying, based on the three-dimensional 
data DTA, DTB, 

[01051 The displaying part 125 performs processing related 
to displaying of data on the display screen of the display 
apparatus 12b, such as displaying of the observation image IM 
generated by the observation image generating part 124. 
[0106] Based on the position and the displaying magnification 
designated by the image designation part 122, the position/size 
calculation part 126 calculates the positions and the sizes of 
the commercial product Q and the article for comparison R so 
that the product image IMA and the comparison article image 1MB 
will be displayed in the commercial product view HGl, 
[0107] When the commercial product Q and the article for 
comparison R are designated at the first stage by the image 
designation part 122, the position/size calculation part 126 
places the commercial product Q and the article for comparison 
R at appropriate positions. For instance, the commercial 
product Q is located toward the left-hand side in the observation 
window WNl and the article for comparison R is located toward 
the right-hand side in the observation window WNl. In such a 
manner that the commercial product Q and the article for 
comparison R will not overlap with each other and that the 
observation image IMwill not deviate from the observation window 
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WNl, the positions of the commercial product Q and the article 
for comparison R and the size of the observation image IM are 
determined. An initial displaying magnification, for example, 
is accordingly calculated* 

[0108] Following this, every time the image designation part 
122 designates or changes the displaying magnification for the 
observation image IM, the size of the observation image IM is 
calculated. In a similar manner, every time the positions of 
the commercial product Q and the article for comparison R are 
changed, the positions of the commercial product Q and the article 
for comparison R are calculated. 
^ [0109] The positions of the commercial product Q and the 

article for comparison R are changed, as a user manipulates the 
t!! product image IMA of the observation image IM or the comparison 

article image 1MB displayed the observation window WNl using 

y^' the mouse 12d as shown in Fig. 11. 

Ill 

[0110] Thus, the position/size calculation part 126 has a 
function of updating the positional information and the 
displaying magnification information in accordance with an 
instruction from a user. 
[Modification of Article for Comparison] 

[0111] A change in position of the article for comparison 
R will now be described. 

[0112] The observation image IM shown in Fig. 11 is an image 
which is generated based on the three-dimensional data DTA 
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regarding the commercial product Q and the three-dimensional 
data DTB regarding the article for comparison R as they are at 
a certain time point. 

[0113] In Fig. 11, the article for comparison Rbef ore changing 
the position is located at a position PI a which is within a virtual 
space S. A Y-Z plane L is a plane which penetrates the position 
Pla and is parallel to the axes Y and Z. 

[0114 ] The position of the article for comparison R is changed 
through two steps of changing on the Y-Z plane L and changing 
in the direction of the axis X. 

[0115] The position after changing on the Y-Z plane L is 
calculated based on the direction and the amount of movement, 
etc., of the comparison article image 1MB using the mouse 12d. 
For instance, when the mouse 12d is moved in the left-right 
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^! direction or the up-down direction, the position is changed in 

the direction of the axis Y or Z of the virtual spaces in proportion 
to the amount of the movement. 

[0116] In a similar manner, the position after changing the 
direction of the axis X is calculated based on the amount of 
movement/ etc., of the article for comparison R using the mouse 
12d in the direction of the axis X. For instance, when the mouse 
12d is moved in the up-down direction, the position of the article 
for comparison R is changed in the direction of the axis X in 
proportion to the amount of the movement. 

[0117] For example, the comparison article image 1MB is moved 
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from the position Pla to a position Plb on the Y-Z plane L and 
further moved from the position Plb to a position Pic in the 
direction of the axis X, and the position of the article for 
comparison R is changed* At this stage, the size of the 
comparison article image 1MB is changed to a size which 
corresponds to the position of the article for comparison R, 
[0118] The comparison article image 1MB is then calculated 
so that the observation image IM will be displayed in accordance 
with the changed position. Similar processing is executed on 
a change to the position of the commercial product Q* 
[0119] However, since it is not possible to change the position 
in the Y-Z axis direction and in the direction of the axis X 
at the same time, processing or operations will be executed step 
by step as described below, 

[0120] As the button BOS shown in Fig, 3 is clicked, 
manipulation of the mouse 12d is recognized as a change to the 
position of the article for comparison R on the Y-Z plane L, 
and the processing described above is executed on the comparison 
article image 1MB, Further, the button B13 is newly displayed 
as the button BOS is clicked, and the button B13 is clicked so 
as to change the position in the direction of the axis X (the 
depth direction) . For instance, the comparison article image 
1MB is moved backward on the screen as the mouse pointer moves 
to above on the screen, whereas the comparison article image 
1MB is moved forward on the screen as the mouse pointer moves 



to below on the screen. The displaying magnification for the 
comparison article image 1MB is changed smaller when the 
comparison article image 1MB is moved backward but changed larger 
when the comparison article image 1MB is moved forward. 
[0121] Further, when the button B02 is clicked, processing 
similar to the above is performed on the commercial product Q, 
[Ordering Processing] 

[0122] The ordering part 113 and the ordering part 127 execute 
processing regarding ordering of the commercial product Q, 
[0123] Fig* 12 is a drawing showing an example of the ordering 
view HG7 . 

[0124] The orderingpart 127 places an order for the commercial 
product Q to the server 11, based on information entered through 
the ordering view HG7 which is shown in Fig. 12. The ordering 
part 113 takes the order for the commercial product Q from the 
ordering part 127, and executes processing regarding ordering. 
[01251 In Fig. 12, in text boxes TB31 to TB34, the quantity 
of the ordered commercial product Q, the name of a purchaser, 
the address to which the commercial product Q should be delivered 
and the credit card number of a credit card used for payment 
are entered. As the button B21 is clicked after making these 
entries, the information entered in the text boxes TB31 to TB34 
is sent to the server 11. 
[Description with Flow Chart] 

[0126] Adescription willbenowmade to the flow of processing 
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in which the terminal apparatus 12 accesses the server 11, a 
catalogue is downloaded and an order for the commercial product 
Q is made, with reference to a flow chart, 

[0127] Fig, 13 is a flow chart for describing the outline 
of the flow of overall processing in the terminal apparatus 12. 
[0128] As shown in Fig. 13, manipulating the terminal 
apparatus 12, a user accesses the server 11 on the Internet (#10) . 
Catalogue information is downloaded from the server 11 (#11) . 
In response, the terminal apparatus 12 displays the catalogue 
view HG2 as that shown in Fig . 4 . The user designates the desired 
commercial product Q in the view (#12) , This makes the 
three-dimensional data DTA regarding the commercial product Q 
downloaded from the server 11 (#13) . At this stage, processing 
programs for the various image processing described above are 
downloaded together. As the downloaded processing program is 
started, processing of displaying the commercial product is 
performed and the commercial product view HGl is displayed on 
the display screen of the terminal apparatus 12 based on the 
three-dimensional data DTA (#14) • It is also possible to select 
or change the commercial product at the step #14. 
[0129] Following this, in response to manipulations a user 
makes, an article for comparison is selected or changed and 
displayed (#15) , the image is rotated (#16) , the image is moved 
(#17) , the image is enlarged or reduced (#18) and other various 
processing is executed (#19) . When there is the commercial 
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product Q the user likes, the user places an order for the 
commercial product Q (#20) . As a result, order data are sent 
from the terminal apparatus 12 to the server 11 (#21) . The 
processing at the steps #15 to #20 is executed as the corresponding 
buttons in the commercial product view HGl are clicked and 
corresponding routines are retrieved. 

[0130] The server 11 receives the order data from the terminal 
apparatus 12 and stores the data in an appropriate memory area. 
Aperson in charge arranges and dispatches the commercial product 
to the user based on the order. 

[0131] Although the processing programs at the later steps 
after the step #14 executed by the terminal apparatus 12 are 
downloaded from the server 11 in the preferred embodiment above, 
these processingprograms maybe supplied in the formof recording 
mediums STl, 2 such as a CD-ROM and a magnetic optical disk (Fig. 
1) . In this case, the processingprograms stored in the recording 
mediums are pre-installed in the terminal apparatus 12. The 
functions at the steps #10 to #13 are provided by means of WWW 
browser which the terminal apparatus 12 usually has. However, 
processing programs for these functions as well may be supplied 
as the recording mediums above such as a CD-ROM. 
[0132] In addition, while the catalogue information, the 
three-dimensional data DTA, DTB and the like are downloaded from 
the server 11, these may be read from recording mediums such 
as a CD-ROM. 



[0133] Further, the three-dimensional data DTA, DTB may be 
processed in the server 11, without downloading the 
three-dimensional data DTA, DTB to the terminal apparatus 12 
or supplying the three-dimensional data DTA, DTB from recording 
mediums. In short, in this case, manipulating the terminal 
apparatus 12, a user provides an instruction, such as selection, 
position, rotation, enlarging and reduction, regarding the 
commercial product Q and the article for comparison R and sends 
the instruction to the server 11. Based on the instruction, 
the server 11 processes the three-dimensional data DTA, DTB and 
sends the processed image data to the terminal apparatus 12. 
It is necessary that the server 11 executes a processing program 
for such processing. 

[0134] Hence, in this case, the user's instruction is sent 
from the terminal apparatus 12 to the server 11, and the image 
data such as the product image IMA and the comparison article 
image 1MB are sent from the server 11 to the terminal apparatus 
12. The terminal apparatus 12 displays the commercial product 
viewHGl based on the received image data. This will be described 
later in more details in relation to a second preferred 
embodiment . 

[0135] Now, an example of processing or partial processing 
at the steps #14 to #17 above will now be described. 
[0136] Fig. 14 is a flowchart showing an example of processing 
of displaying the commercial products. 



[0137] In Fig* 14, the size of the image data on the selected 
commercial product Q is detected from the product information 
DTQ which is stored in the data storage part 112 (#100) . The 
image size of the selected commercial product Q is compared with 
the pixel number in a display area (observation window WNl), 
a display size of and a displaying magnification for the product 
image IMA are then calculated (#101) . Image data for 
two-dimensional displaying are generated based on the 
three-dimensional data DTA and read (#102), and displayed in 
O the observation window WNl (#103) . As a result, the product 

P image IMA are displayed in the display screen at an appropriate 

^ displaying magnification. 

P [0138] Fig. 15 is a flow chart showing an example of processing 

O of automatic selection of articles for comparison. This flow 

I U 

Ci chart is executed when the button B07 is clicked in the commercial 

Q product view HGl which is shown in Fig. 3. 

[0139] First, the types (product classes) and the sizes of 
the commercial products displayed at this stage are detected 
based on the product information DTQ (#200) . A comparison 
article group corresponding to the types of the displayed 
commercial products is selected (#201) . For instance, when the 
type of the commercial product Q is "furniture" for example, 
"tableware," "human being" or the like to be placed around the 
furniture is extracted as the articles for comparison R, and 
when the type of the commercial product Q is "electric appliance, " 
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"CD" or the like is extracted as the articles for comparison 
R. 

[0140] One article for comparison R corresponding to the size 
of the commercial product Q is selected from the articles for 
comparison R which are included in the selected comparison 
article group (#202) . Relatively large articles for comparison 
R are associated with large commercial products Q. 
[0141] A displaying magnification for the comparison article 
image 1MB is calculated from the size of and a displaying 
magnification for the displayed product image IMA and the sizes 
of the displayed articles for comparison R (#203) • The 
comparison article image 1MB is displayed at a predetermined 
position within the observation window WNl based on the 
calculated displaying magnification (#204, #205) • 
[0142] Fig. 16 is a flow chart showing an example of processing 
of rotating an article for comparison during image rotation. 
This flow chart is executed when the button B04 is clicked in 
the commercial product view HGl which is shown in Fig. 3. 
[0143] Whether rotation of the product image IMA is selected 
is judged (#300) . When YES, the sequence proceeds to a flow 
chart (Fig. 17) which requires the product image IMA and the 
comparison article image 1MB to rotate together. 
[0144] When the product image IMA is not selected, it is 
determined that rotation of only the comparison article image 
1MB is instructed . As the comparison article image 1MB is dragged 



within the observation window WNl, the dragging direction and 
the amount of the movement are detected (#301) . 
[0145] From the detected direction and amount of the movement, 
the direction in which the image is rotated and the angle of 
rotation are calculated (#302) . The comparison article image 
1MB as it is after rotation is identified based on the direction 
and the angle of rotation, and displayed (#303, #304) . 
[0146] When neither rotation of the commercial product Q nor 
other buttons is selected (NO at #305, #306), rotation of the 
comparison article image 1MB is continued. As other button is 
selected (YES at #306) , the sequence proceeds to the selected 
processing. 

[0147] Fig, 17 is a flow chart showing an example of processing 
of rotating an article for comparison and a commercial product 
during image rotation. This flow chart is executed when both 
the button BOl and the button B04 are clicked in the commercial 
product view HGl which is shown in Fig. 3. 

[0148] When the button B14 for auto-rotation is clicked (YES 
at #400) , the steps #406 to #409 for auto-rotation are executed. 
When the button B15 for orbital rotation is clicked (YES at #401) , 
the steps #402 to #405 for orbital rotation are carried out. 
The contents of the processing at these the steps #402 to #405 
and the steps #406 to #409 are similar to those at the steps 
#301 to #304 above except for that rotation is auto-rotation 
or orbital rotation. 



[0149] Fig, 18 is a flow chart showing an example of processing 
of moving an article for comparison during image movement • This 
flow chart is executed when the button BOS is clicked in the 
commercial product view HGl which is shown in Fig, 3. 

[0150] As a user drags the comparison article image 1MB within 
the observation window WNl, the dragging direction and the amount 
of the movement are detected (#500) • 

[0151] From the detected direction and amount of themovement, 
the direction in which the image is moved and the angle of movement 
are calculated (#501) , The comparison article image 1MB as it 
^ is after movement is identified based on the direction and the 

m 

angle of movement, and displayed (#502, #503) • 

[0152] Unless other button is selected, the comparison 

article image 1MB is continuously moved. When other button is 

P4 

'^l selected (YES at #504), the sequence proceeds to the selected 

processing. 

[0153] In this preferred embodiment, since images are 
displayed so that the commercial product Q can be compared with 
the articles for comparison R in the observation window WNl, 
it is easier for a user to grasp the size of the commercial product 
with his or her sense. Further, since the three-dimensional 
data DTA are used to display the commercial product Q and the 
articles for comparison R, it is possible to display natural 
images, and with the displayed image rotated or otherwise 
processed, it is possible to observe the commercial product Q 
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and the articles for comparison R from any direction. 
[Second Preferred Embodiment] 

[0154] Fig. 19 is a drawing of the functional structure of 
an electronic catalogue system IB in a second preferred 
embodiment, and Fig. 20 is a drawing showing an example of the 
commercial product view HG8 . 

[0155] In the electronic catalogue system 1 according to the 
first preferred embodiment, the terminal apparatus 12 generates 
the product image IMA and the comparison article image 1MB based 
on the three-dimensional data DTA, DTB which are downloaded from 
the server 11. 

[0156] In the electronic catalogue system IB according to 
the second preferred embodiment, the terminal apparatus 12 
receives the image data regarding the commercial product Q and 
the articles for comparison R generated by the server 11 and 
displays the images of the commercial product Q and the articles 
for comparison R based on the image data. 

[0157] As the electronic catalogue system IB shown in Fig. 
1, the structure of the electronic catalogue system IB is formed 
by the server 11 and the like. Having such a structure, the 
electronic catalogue system IB realizes a functional structure 
as that shown in Fig. 14. 

[0158] In the electronic catalogue system IB shown in Fig. 
14, the server 11 includes a communication control part 211, 
a data storage part 212, an ordering part 213, an image generating 



part 214, etc. The terminal apparatus 12 includes a 
communication control part 221, an image requesting part 222, 
a displaying part 225, an ordering part 227, etc. 
[0159] The communication control parts 211, 221, the data 
storage part 212, the ordering part 213 and the ordering part 
227 have similar functions to the communication control parts 
111, 121, the data storage part 112, the ordering part 113 and 
the ordering part 127 according to the first preferred 
embodiment • 

[0160] The image requesting part 222 designates the 
commercial product Q and the articles for comparison R to be 
displayed and the directions in which the commercial product 
Q and the articles for comparison R are to be observed. 
[0161] In response to the designation given from the image 
requesting part 222, the image generating part 214 generates 
image data DT2A, DT2B based on the three-dimensional data DTA, 
DTB corresponding to the commercial product Q and the articles 
for comparison R. 

[0162] For instance, when "table 1" and "cup" are designated 
in the catalogue view HG2 shown in Fig. 4 and the article for 
comparison list view HG3 shown in Fig. 5 and designation is made 
so as to observe these from the side, the image data DT2A, DT2B 
for displaying a product image IM2A and a comparison article 
image IM2B as those shown in Fig. 20 are generated. 
[0163] The displaying part 225 downloads the generated image 



data DT2A, DT2B from the server 11, and the product image IM2A 
and the comparison article image IM2B are displayed in an 
observation window WN2 in the commercial product view HG8 shown 
in Fig. 20 based on the image data. 

[0164] In the second preferred embodiment, since the 
observation image IM is generated by the server 11, a processing 
load upon the terminal apparatus 12 is lighter than in the first 
preferred embodiment. Further, since the image is generated 
while designating the direction in which the commercial product 
p Q is observed, it is possible to observe the commercial product 

p Q at various angles, and therefore, a user can easily grasp the 

Si size of the commercial product, etc., with his or her sense, 

ft [0165] Fig. 21 is a drawing showing an example of the commercial 

Q product view HGl which shows a plurality of commercial products 

Q Q, and Fig. 22 is a drawing showing an example of the observation 

Cli window WNl which shows a ruler and the like. 

m 

[0166] While only one commercial product Q is displayed in 
the commercial product view HGl and the commercial product view 
HG8 in the second preferred embodiment, the plurality of 
commercial products Q may be displayed. For instance, as shown 
in Fig. 21, a table Ql and a table Q2 may be displayed at the 
same time . In this case, the commercial product view HGl includes 
buttons B71 to B74 for individually rotating or moving the table 
Ql and the table Q2 and buttons B75 and B76 for ordering. The 
commercial product view HG8 as well similarly includes buttons 
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for the respective commercial products Q which are displayed. 
Allowing to compare the sizes of the commercial products Q with 
each other, this example is convenient when one wishes to purchase 
the plurality of commercial products Q, e.g., a combination of 
a table and a chair, as a set . A program for causing the terminal 
apparatus 12 to achieve the processing of this example is 
approximately similar to the flow chart shown in Fig. 13. 
[0167] As shown in Fig. 22, the commercial product view HGl 
may include a ruler or graduated coordinate axis for showing 
the width, the height and the like of the commercial product 
Q or the article for comparison R. As shown in Fig. 22(a), rulers 
may be displayed at the top and on the right-hand side in the 
observation window WNl . Alternatively, as shown in Fig. 22 (b) , 
graduated coordinate axes may be displayed over the product image 
IMA. 

[0168] The structures of, the contents of the processing in, 
the order of the processing in the entirety or the respective 
portions of the electronic catalogue systems 1, IB, the server 
11 or the terminal apparatus 12, the structures of the views 
such as the commercial product view HGl, the method of 
manipulating the mouse 12d and the like may be appropriately 
modified along the intention of the present invention. 
[0169] As described above, according to the present invention, 
with a commercial product displayed together with an article 
for comparison on the display screen, it is possible to grasp 



the size of the commercial product with sense. 
[0170] According to the inventions described in claims 1 
through 9 in particular, since the three-dimensional data are 
used for generation of the images of a commercial product and 
an article for comparison, it is possible to display natural 
images • 

[0171] Although the present invention has been fully 
described by way of examples with reference to the accompanying 
drawings, it is to be noted that various changes andmodif ications 
O will be apparent to those skilled in the art. Therefore, unless 

ffl such changes andmodif ication depart from the scope of the present 

Hi invention, they should be construed as being included therein. 
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